Tools for assessing quality of studies investigating health interventions using real-world data: a literature review and content analysis.

OBJECTIVES: We aimed to identify existing appraisal tools for non-randomised studies of interventions (NRSIs) and to compare the criteria that the tools provide at the quality-item level. DESIGN: Literature review through three approaches: systematic search of journal articles, snowballing search of reviews on appraisal tools and grey literature search on websites of health technology assessment (HTA) agencies. DATA SOURCES: Systematic search: Medline; Snowballing: starting from three articles (D'Andrea et al, Quigley et al and Faria et al); Grey literature: websites of European HTA agencies listed by the International Network of Agencies for Health Technology Assessment. Appraisal tools were searched through April 2022. ELIGIBILITY CRITERIA FOR SELECTING STUDIES: We included a tool, if it addressed quality concerns of NRSIs and was published in English (unless from grey literature). A tool was excluded, if it was only for diagnostic, prognostic, qualitative or secondary studies. DATA EXTRACTION AND SYNTHESIS: Two independent researchers searched, screened and reviewed all included studies and tools, summarised quality items and scored whether and to what extent a quality item was described by a tool, for either methodological quality or reporting. RESULTS: Forty-nine tools met inclusion criteria and were included for the content analysis. Concerns regarding the quality of NRSI were categorised into 4 domains and 26 items. The Research Triangle Institute Item Bank (RTI Item Bank) and STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) were the most comprehensive tools for methodological quality and reporting, respectively, as they addressed (n=20; 17) and sufficiently described (n=18; 13) the highest number of items. However, none of the tools covered all items. CONCLUSION: Most of the tools have their own strengths, but none of them could address all quality concerns relevant to NRSIs. Even the most comprehensive tools can be complemented by several items. We suggest decision-makers, researchers and tool developers consider the quality-item level heterogeneity, when selecting a tool or identifying a research gap. OSF REGISTRATION NUMBER: OSF registration DOI (https://doi.org/10.17605/OSF.IO/KCSGX).

Incidence and individual risk prediction of post-COVID-19 cardiovascular disease in the general population: a multivariable prediction model development and validation study.

Aims: Previous studies suggest relatively increased cardiovascular risk after COVID-19 infection. This study assessed incidence and explored individual risk and timing of cardiovascular disease occurring post-COVID-19 in a large primary care database. Methods and results: Data were extracted from the UK's Clinical Practice Research Datalink. Incidence rates within 180 days post-infection were estimated for arterial or venous events, inflammatory heart disease, and new-onset atrial fibrillation or heart failure. Next, multivariable logistic regression models were developed on 220 751 adults with COVID-19 infection before 1 December 2020 using age, sex and traditional cardiovascular risk factors. All models were externally validated in (i) 138 034 vaccinated and (ii) 503 404 unvaccinated adults with a first COVID-19 infection after 1 December 2020. Discriminative performance and calibration were evaluated with internal and external validation. Increased incidence rates were observed up to 60 days after COVID-19 infection for venous and arterial cardiovascular events and new-onset atrial fibrillation, but not for inflammatory heart disease or heart failure, with the highest rate for venous events (13 per 1000 person-years). The best prediction models had c-statistics of 0.90 or higher. However, <5% of adults had a predicted 180-day outcome-specific risk larger than 1%. These rare outcomes complicated calibration. Conclusion: Risks of arterial and venous cardiovascular events and new-onset atrial fibrillation are increased within the first 60 days after COVID-19 infection in the general population. Models' c-statistics suggest high discrimination, but because of the very low absolute risks, they are insufficient to inform individual risk management.

Cross-Regional Data Initiative for the Assessment and Development of Treatment for Neurological and Mental Disorders.

Purpose: To describe and categorize detailed components of databases in the Neurological and Mental Health Global Epidemiology Network (NeuroGEN). Methods: An online 132-item questionnaire was sent to key researchers and data custodians of NeuroGEN in North America, Europe, Asia and Oceania. From the responses, we assessed data characteristics including population coverage, data follow-up, clinical information, validity of diagnoses, medication use and data latency. We also evaluated the possibility of conversion into a common data model (CDM) to implement a federated network approach. Moreover, we used radar charts to visualize the data capacity assessments, based on different perspectives. Results: The results indicated that the 15 databases covered approximately 320 million individuals, included in 7 nationwide claims databases from Australia, Finland, South Korea, Taiwan and the US, 6 population-based electronic health record databases from Hong Kong, Scotland, Taiwan, the Netherlands and the UK, and 2 biomedical databases from Taiwan and the UK. Conclusion: The 15 databases showed good potential for a federated network approach using a common data model. Our study provided publicly accessible information on these databases for those seeking to employ real-world data to facilitate current assessment and future development of treatments for neurological and mental disorders.

The associations of sodium-glucose cotransporter-2 inhibitors versus dipeptidyl peptidase-4 inhibitors as add-on to metformin with fracture risk in patients with type 2 diabetes mellitus.

AIM: To investigate whether sodium-glucose cotransporter-2 (SGLT2) inhibitor use as compared to dipeptidyl peptidase-4 (DPP-4) inhibitor use as add-on to metformin is associated with the risk of any fracture or major osteoporotic fractures (MOFs). METHODS: A cohort study using the Clinical Practice Research Datalink (CPRD) Aurum database was conducted. All patients aged 18 years and older with a first-ever prescription for a DPP-4 inhibitor or an SGLT2 inhibitor as add-on to metformin between January 1, 2013 and June 30, 2020 were selected. Patients starting with SGLT2 inhibitors were matched (up to 1:3) on propensity scores to patients starting with DPP-4 inhibitors. Propensity scores were calculated based on sex, age, body mass index, comorbidities, comedication and lifestyle factors. Cox proportional hazard models were used to estimate the risk of fracture with SGLT2 inhibitor use as compared to DPP-4 inhibitor use. RESULTS: A total of 13 807 SGLT2 inhibitor users (age 55.4 ± 10.6 years, 36.7% female) were included in this study, matched with 28 524 DPP-4 inhibitor users (age 55.4 ± 8.0 years, 36.4% female). The risk of any fracture with current SGLT2 inhibitor use was similar compared with current DPP-4 inhibitor use (adjusted hazard ratio [aHR] 1.09, 95% confidence interval [CI] 0.91-1.31), as was the risk of MOFs (aHR 0.89, 95% CI 0.64-1.22) and the risk of fractures at any of the individual MOF sites. Additionally, no association was found with duration of SGLT2 inhibitor use (longest duration >811 days) for any of the individual SGLT2 inhibitor agents, or after stratification by sex and age. CONCLUSION: Use of SGLT2 inhibitors was not associated with the risk of any fracture, MOFs or fracture at the individual MOF sites when compared to DPP-4 inhibitor use.

Improving 10-year cardiovascular risk prediction in apparently healthy people: flexible addition of risk modifiers on top of SCORE2.

AIMS: In clinical practice, factors associated with cardiovascular disease (CVD) like albuminuria, education level, or coronary artery calcium (CAC) are often known, but not incorporated in cardiovascular risk prediction models. The aims of the current study were to evaluate a methodology for the flexible addition of risk modifying characteristics on top of SCORE2 and to quantify the added value of several clinically relevant risk modifying characteristics. METHODS AND RESULTS: Individuals without previous CVD or DM were included from the UK Biobank; Atherosclerosis Risk in Communities (ARIC); Multi-Ethnic Study of Atherosclerosis (MESA); European Prospective Investigation into Cancer, The Netherlands (EPIC-NL); and Heinz Nixdorf Recall (HNR) studies (n = 409 757) in whom 16 166 CVD events and 19 149 non-cardiovascular deaths were observed over exactly 10.0 years of follow-up. The effect of each possible risk modifying characteristic was derived using competing risk-adjusted Fine and Gray models. The risk modifying characteristics were applied to individual predictions with a flexible method using the population prevalence and the subdistribution hazard ratio (SHR) of the relevant predictor. Risk modifying characteristics that increased discrimination most were CAC percentile with 0.0198 [95% confidence interval (CI) 0.0115; 0.0281] and hs-Troponin-T with 0.0100 (95% CI 0.0063; 0.0137). External validation was performed in the Clinical Practice Research Datalink (CPRD) cohort (UK, n = 518 015, 12 675 CVD events). Adjustment of SCORE2-predicted risks with both single and multiple risk modifiers did not negatively affect calibration and led to a modest increase in discrimination [0.740 (95% CI 0.736-0.745) vs. unimproved SCORE2 risk C-index 0.737 (95% CI 0.732-0.741)]. CONCLUSION: The current paper presents a method on how to integrate possible risk modifying characteristics that are not included in existing CVD risk models for the prediction of CVD event risk in apparently healthy people. This flexible methodology improves the accuracy of predicted risks and increases applicability of prediction models for individuals with additional risk known modifiers.

Heart disease is a major health concern worldwide, and predicting an individual's risk for developing heart disease is an important tool for prevention. Current risk prediction models often use factors such as age, gender, smoking, and blood pressure, but other factors like education level, albuminuria (protein in the urine), and coronary artery calcium (CAC) may also affect an individual's risk. The aim of this study was to develop a new method for using these additional risk factors for predicting risk even more accurately. The researchers used data from several large studies that included over 400 000 apparently healthy individuals who were followed for 10 years. They examined the effect of various risk factors on cardiovascular disease (CVD) risk using a statistical model. They found that adding coronary scan ('CAC score'); NT-proBNP, a biomarker of heart strain; and hs-Troponin-T, a marker of heart damage, to the existing risk prediction model (SCORE2) improved the accuracy of predicted CVD risk. The key findings are: The methods presented in the current study can help to add additional risk factors to predictions of existing models, such as SCORE2. This flexible method may help identify individuals who are at higher risk for CVD and guide prevention strategies.

Bias in observational studies on the effectiveness of in hospital use of hydroxychloroquine in COVID-19.

PURPOSE: During the first waves of the coronavirus pandemic, evidence on potential effective treatments was urgently needed. Results from observational studies on the effectiveness of hydroxychloroquine (HCQ) were conflicting, potentially due to biases. We aimed to assess the quality of observational studies on HCQ and its relation to effect sizes. METHODS: PubMed was searched on 15 March 2021 for observational studies on the effectiveness of in-hospital use of HCQ in COVID-19 patients, published between 01/01/2020 and 01/03/2021 on. Study quality was assessed using the ROBINS-I tool. Association between study quality and study characteristics (journal ranking, publication date, and time between submission and publication) and differences between effects sizes found in observational studies compared to those found in RCTs, were assessed using Spearman's correlation. RESULTS: Eighteen of the 33 (55%) included observational studies were scored as critical risk of bias, eleven (33%) as serious risk and only four (12%) as moderate risk of bias. Biases were most often scored as critical in the domains related to selection of participants (n = 13, 39%) and bias due to confounding (n = 8, 24%). There were no significant associations found between the study quality and the characteristics nor between the study quality and the effect estimates. DISCUSSION: Overall, the quality of observational HCQ studies was heterogeneous. Synthesis of evidence of effectiveness of HCQ in COVID-19 should focus on RCTs and carefully consider the added value and quality of observational evidence.

Cohort Event Monitoring of Adverse Reactions to COVID-19 Vaccines in Seven European Countries: Pooled Results on First Dose.

INTRODUCTION: COVID-19 vaccines were rapidly authorised, thus requiring intense post-marketing re-evaluation of their benefit-risk profile. A multi-national European collaboration was established with the aim to prospectively monitor safety of the COVID-19 vaccines through web-based survey of vaccinees. METHODS: A prospective cohort event monitoring study was conducted with primary consented data collection in seven European countries. Through the web applications, participants received and completed baseline and up to six follow-up questionnaires on self-reported adverse reactions for at least 6 months following the first dose of COVID-19 vaccine (Netherlands, France, Belgium, UK, Italy) and baseline and up to ten follow-up questionnaires for one year in Germany and Croatia. Rates of adverse reactions have been described by type (solicited, non-solicited; serious/non-serious; and adverse events of special interest) and stratified by vaccine brand. We calculated the frequency of adverse reaction after dose 1 and prior to dose 2 among all vaccinees who completed at least one follow-up questionnaire. RESULTS: Overall, 117,791 participants were included and completed the first questionnaire in addition to the baseline: 88,196 (74.9%) from Germany, 27,588 (23.4%) from Netherlands, 984 (0.8%) from France, 570 (0.5%) from Italy, 326 (0.3%) from Croatia, 89 (0.1%) from the UK and 38 (0.03%) from Belgium. There were 89,377 (75.9%) respondents who had received AstraZeneca vaccines, 14,658 (12.4%) BioNTech/Pfizer, 11,266 (9.6%) Moderna and 2490 (2.1%) Janssen vaccines as a first dose. Median age category was 40-49 years for all vaccines except for Pfizer where median age was 70-79 years. Most vaccinees were female with a female-to-male ratio of 1.34, 1.96 and 2.50 for AstraZeneca, Moderna and Janssen, respectively. BioNtech/Pfizer had slightly more men with a ratio of 0.82. Fatigue and headache were the most commonly reported solicited systemic adverse reactions and injection-site pain was the most common solicited local reaction. The rates of adverse events of special interest (AESIs) were 0.1-0.2% across all vaccine brands. CONCLUSION: This large-scale prospective study of COVID-19 vaccine recipients showed, for all the studied vaccines, a high frequency of systemic reactions, related to the immunogenic response, and local reactions at the injection site, while serious reactions or AESIs were uncommon, consistent with those reported on product labels. This study demonstrated the feasibility of setting up and conducting cohort event monitoring across multiple European countries to collect safety data on novel vaccines that are rolled out at scale in populations which may not have been included in pivotal trials.

Prescribing of low-dose rivaroxaban in patients with atherosclerotic cardiovascular disease in the United Kingdom and the Netherlands.

AIMS: Low-dose rivaroxaban has been indicated for the management of atherosclerotic cardiovascular disease (ASCVD) after recent (2019-2020) updates to European guidelines. We aimed to describe prescription trends of low-dose rivaroxaban in ASCVD patients over the period 2015-2022 in two European countries, to compare the trends before and after guideline changes, and to determine the characteristics of users. METHODS: In a cross-sectional interrupted time series analysis, utilization of low-dose rivaroxaban (2.5 mg, twice daily) was measured in Clinical Practice Research Datalink Aurum (United Kingdom [UK]) and the PHARMO Database Network (the Netherlands) from 1 January 2015 to 28 February 2022 in patients with an ASCVD diagnosis. Incidence rates (IRs) and incidence rate ratios (IRRs) of new use (within 182 days) compared to the reference period, 2015-2018, were calculated. Age, sex and comorbidities of users were compared to those of nonusers. RESULTS: In the UK, from 721 271 eligible subjects the IR of new use of low-dose rivaroxaban in the period 2015-2018, before guideline changes, was 12.4 per 100 000 person-years and after guideline changes in 2020-2022 was 124.0 (IRR 10.0, 95% confidence interval [CI] 8.5, 11.8). In the Netherlands from 394 851 subjects, the IR in 2015-2018 was 2.4 per 100 000 person-years and in 2020 was 16.3 (IRR 6.7, 95% CI 4.0, 11.4). Users were younger (UK mean difference [MD] -6.1 years, Netherlands -2.4 years; P < .05) and more likely to be male (UK difference 11.5%, Netherlands 13.4%; P < .001) than nonusers. CONCLUSIONS: There was a statistically significant increase in the use of low-dose rivaroxaban for the management of ASCVD after guideline changes in the UK and the Netherlands. There were international differences, but low-dose rivaroxaban has not been put into widespread practice.

Primary nonadherence to drugs prescribed by general practitioners: A Dutch database study.

AIM: Primary nonadherence (PNA) is defined as not filling the first prescription for a drug treatment. PNA can lead not only to poor patient outcomes but also to exposure misclassification in written prescription databases. This study aims to estimate PNA in primary care in the Netherlands and to investigate associated factors. METHODS: Patients from the Nivel Primary Care Database (Nivel-PCD) who received a new prescription (>1 year not prescribed) from a general practitioner in 2012 were linked to pharmacy dispensing information of consenting pharmacies based on sex, year of birth, four-digit postal code and at least 50% matching Anatomical Therapeutic Classification codes. PNA was defined as not having a prescription dispensed within 30 days from the prescribing date. PNA was assessed overall and per drug class. The associations between PNA and several patient- and prescription-related characteristics were assessed using mixed-effects logistic regression models. RESULTS: After matching 86 361 of 396 251 subjects (21.8%) in the Nivel-PCD records to the pharmacy records, this study included 65 877 subjects who received 181 939 new drug prescriptions. Overall, PNA was 11.5%. PNA was lowest for thyroid hormones (5.5%) and highest for proton pump inhibitors (12.8%). Several factors were associated with PNA, such as having comorbidities (odds ratio [OR] 1.46, 95% confidence interval [CI] 1.37-1.56 for >3 active diagnoses, compared to no active diagnoses) or reimbursement status (OR 2.78, 95% CI 2.65-2.92 for not reimbursed drugs compared to fully reimbursed drugs). CONCLUSIONS: A total of 11.5% of newly prescribed drugs were not dispensed. This can lead to overestimation of the actual drug exposure status when using written prescription databases.

Myocarditis and pericarditis associated with SARS-CoV-2 vaccines: A population-based descriptive cohort and a nested self-controlled risk interval study using electronic health care data from four European countries.

Background: Estimates of the association between COVID-19 vaccines and myo-/pericarditis risk vary widely across studies due to scarcity of events, especially in age- and sex-stratified analyses. Methods: Population-based cohort study with nested self-controlled risk interval (SCRI) using healthcare data from five European databases. Individuals were followed from 01/01/2020 until end of data availability (31/12/2021 latest). Outcome was first myo-/pericarditis diagnosis. Exposures were first and second dose of Pfizer, AstraZeneca, Moderna, and Janssen COVID-19 vaccines. Baseline incidence rates (IRs), and vaccine- and dose-specific IRs and rate differences were calculated from the cohort The SCRI calculated calendar time-adjusted IR ratios (IRR), using a 60-day pre-vaccination control period and dose-specific 28-day risk windows. IRRs were pooled using random effects meta-analysis. Findings: Over 35 million individuals (49·2% women, median age 39-49 years) were included, of which 57·4% received at least one COVID-19 vaccine dose. Baseline incidence of myocarditis was low. Myocarditis IRRs were elevated after vaccination in those aged < 30 years, after both Pfizer vaccine doses (IRR = 3·3, 95%CI 1·2-9.4; 7·8, 95%CI 2·6-23·5, respectively) and Moderna vaccine dose 2 (IRR = 6·1, 95%CI 1·1-33·5). An effect of AstraZeneca vaccine dose 2 could not be excluded (IRR = 2·42, 95%CI 0·96-6·07). Pericarditis was not associated with vaccination. Interpretation: mRNA-based COVID-19 vaccines and potentially AstraZeneca are associated with increased myocarditis risk in younger individuals, although absolute incidence remains low. More data on children (≤ 11 years) are needed.

Use of sodium-glucose co-transporter 2 inhibitors, changes in body mass index and risk of fracture: A population-based cohort study.

AIMS: Sodium-glucose co-transporter-2 (SGLT-2) inhibitor-induced weight loss might play a role in the debated elevated fracture risk with these agents. The aim of the current study was to investigate the association between SGLT-2 inhibitor use, changes in body mass index (BMI) and fracture risk. METHODS: A retrospective cohort study was conducted using data from the UK Clinical Practice Research Datalink (CPRD) GOLD (2013-2018). The study population (N = 34,960) consisted of adults with diabetes initiating a sulphonylurea or SGLT-2 inhibitor. Cox proportional hazards models estimated hazard ratios (HRs) for major osteoporotic fracture with SGLT-2 inhibitor use versus sulphonylurea use, stratified by change in BMI, average daily dose and cumulative dose. Analyses were adjusted for age, sex, lifestyle variables, comorbidities, and concomitant drug use. RESULTS: SGLT-2 inhibitor use was not associated with an increased fracture risk compared to sulphonylurea use (adjusted HR 1.19; 95% confidence interval (CI): 0.80-1.79). This finding remained consistent after stratification by BMI change. However, the highest cumulative dose category was associated with an increased fracture risk (adjusted HR: 2.10, 95 %CI: 1.11-3.99). CONCLUSION: SGLT-2 inhibitor use was not associated with increased osteoporotic fracture risk, irrespective of change in BMI. However, a high cumulative dose could be an important risk factor.

Mapping the risk of infections in patients with multiple sclerosis: A multi-database study in the United Kingdom Clinical Practice Research Datalink GOLD and Aurum.

BACKGROUND: People with multiple sclerosis (pwMS) have an increased risk of infections; risk factors include underlying disease, physical impairment and use of some disease-modifying treatments. OBJECTIVE: To quantify changes in population-level infection rates among pwMS and compare these to the general population and people with rheumatoid arthritis (pwRA), and identify patient characteristics predictive of infections after MS diagnosis. METHODS: We conducted a multi-database study using data on 23,226 people with MS diagnosis from the UK Clinical Practice Research Datalink Aurum and GOLD (January 2000-December 2020). PwMS were matched to MS-free controls and pwRA. We calculated infection rates, and estimated incidence rate ratios (IRR) and 95% confidence intervals (CI) of predictors for infections ⩽ 5 years after MS diagnosis using Poisson regression. RESULTS: Among pwMS, overall infection rates remained stable - 1.51-fold (1.49-1.52) that in MS-free controls and 0.87-fold (0.86-0.88) that in pwRA - although urinary tract infection rate per 1000 person-years increased from 98.7 (96.1-101) (2000-2010) to 136 (134-138) (2011-2020). Recent infection before MS diagnosis was most predictive of infections (1 infection: IRR 1.92 (1.86-1.97); ⩾2 infections: IRR 3.00 (2.89-3.10)). CONCLUSION: The population-level elevated risk of infection among pwMS has remained stable despite the introduction of disease-modifying treatments.

Characteristics of patients with lung cancer in clinical practice and their potential eligibility for clinical trials evaluating tyrosine kinase inhibitors or immune checkpoint inhibitors.

INTRODUCTION: In- and exclusion criteria of randomized clinical trials (RCTs) aim to include a homogeneous study-population. This study compared characteristics of lung cancer patients from phase III RCTs evaluating tyrosine kinase inhibitors (TKIs) or immune checkpoint inhibitors (ICIs) with characteristics of lung cancer patients in a real world setting in the United Kingdom. METHODS: A retrospective study was conducted using the Clinical Practice Research Datalink GOLD. Patients (N = 9239) with a first ever lung cancer registration between 2014 and 2018 were identified. Eligibility for inclusion was assessed for twelve RCTs (evaluating TKIs or ICIs). Reasons for potential exclusion and the number of unmet criteria were assessed for each RCT independently. OS was assessed using Kaplan-Meier and Cox proportional hazards analyses. RESULTS: The proportion of potentially eligible patients was 74.3% and 51.9% for TKI and ICI RCTs, respectively. History of another malignancy, renal insufficiency or concomitant drug-use were main reasons for exclusion. OS was considerably longer for potentially eligible patients. Hazards ratios varied from 1.17 (95% confidence interval, 1.11-1.24) to 1.35 (1.20-1.42) across the RCTs. CONCLUSION: This study showed that a considerable proportion of lung cancer patients in a real-world setting would have been ineligible for participation in phase III RCTs and that potentially ineligible patients experienced a shorter OS.

Oral anticoagulants in patients with atrial fibrillation at low stroke risk: a multicentre observational study.

AIMS: There is currently no consensus on whether atrial fibrillation (AF) patients at low risk for stroke (one non-sex-related CHA2DS2-VASc point) should be treated with an oral anticoagulant. METHODS AND RESULTS: We conducted a multi-country cohort study in Sweden, Denmark, Norway, and Scotland. In total, 59 076 patients diagnosed with AF at low stroke risk were included. We assessed the rates of stroke or major bleeding during treatment with a non-vitamin K antagonist oral anticoagulant (NOAC), a vitamin K antagonist (VKA), or no treatment, using inverse probability of treatment weighted (IPTW) Cox regression. In untreated patients, the rate for ischaemic stroke was 0.70 per 100 person-years and the rate for a bleed was also 0.70 per 100 person-years. Comparing NOAC with no treatment, the stroke rate was lower [hazard ratio (HR) 0.72; 95% confidence interval (CI) 0.56-0.94], and the rate for intracranial haemorrhage (ICH) was not increased (HR 0.84; 95% CI 0.54-1.30). Comparing VKA with no treatment, the rate for stroke tended to be lower (HR 0.81; 95% CI 0.59-1.09), and the rate for ICH tended to be higher during VKA treatment (HR 1.37; 95% CI 0.88-2.14). Comparing NOAC with VKA treatment, the rate for stroke was similar (HR 0.92; 95% CI 0.70-1.22), but the rate for ICH was lower during NOAC treatment (HR 0.63; 95% CI 0.42-0.94). CONCLUSION: These observational data suggest that NOAC treatment may be associated with a positive net clinical benefit compared with no treatment or VKA treatment in patients at low stroke risk, a question that can be tested through a randomized controlled trial.

Key Considerations in the Health Technology Assessment of Advanced Therapy Medicinal Products in Scotland, The Netherlands, and England.

OBJECTIVES: Advanced therapy medicinal products (ATMPs) are highly innovative therapies. Their costs and uncertain value claims have raised concerns among health technology assessment (HTA) bodies and payers. Little is known about how underlying considerations in HTA of ATMPs shape assessment and reimbursement recommendations. We aim to identify and assess key considerations that played a role in HTA of ATMPs underlying reimbursement recommendations. METHODS: A review of HTA reports was conducted of all authorized ATMPs in Scotland, The Netherlands, and England. Considerations were extracted and categorized into EUnetHTA Core Model domains. Per jurisdiction, considerations were aggregated and key considerations identified (defined as occurring in >1/assessment per jurisdiction). A narrative analysis was conducted comparing key considerations between jurisdictions and different reimbursement recommendations. RESULTS: We identified 15 ATMPs and 18 HTA reports. In The Netherlands and England most key considerations were identified in clinical effectiveness (EFF) and cost- and economic effectiveness (ECO) domains. In Scotland, the social aspects domain yielded most key considerations, followed by ECO and EFF. More uncertainty in evidence and assessment outcomes was accepted when orphan or end-of-life criteria were applied. A higher percentage of considerations supporting recommendations were identified for products with positive recommendations compared with restricted and negative recommendations. CONCLUSIONS: This is the first empirical review of HTA's using the EUnetHTA Core Model to identify and structure key considerations retrospectively. It provides insights in supporting and opposing considerations for reimbursement of individual products and differences between jurisdictions. Besides the EFF and ECO domain, the social, ethical, and legal domains seem to bear considerable weight in assessment of ATMPs.

The Role of Regulator-Imposed Post-Approval Studies in Health Technology Assessments for Conditionally Approved Drugs.

BACKGROUND: The European Medicines Agency (EMA) aims to resolve uncertainties associated with conditionally approved drugs by imposing post-approval studies. Results from these studies may be relevant for health technology assessment (HTA) organizations. This study investigated the role of regulator-imposed post-approval studies within HTA. METHODS: For all conditionally approved drugs up to December 2018, regulator-imposed post-approval studies were identified from EMA's public assessment reports. The availability for and inclusion of study results in relative effectiveness (re)assessments were analyzed for 4 European HTA organizations: NICE (National Institute for Health and Care Excellence, England/Wales), HAS (Haute Autorité de Santé, France), ZIN (Zorginstituut Nederland, the Netherlands) and the European Network for Health Technology Assessment (EUnetHTA, Europe). When study results became available between an HTA organization's initial assessment and reassessment, it was evaluated whether and how they affected the assessment and its outcome. RESULTS: For 36 conditionally approved drugs, 98 post-approval studies were imposed. In total, 81 initial relative effectiveness assessments (REAs) and 13 reassessments were available, with numbers of drugs (re)assessed varying greatly between jurisdictions. Study results were available for 16 initial REAs (20%) and included in 14 (88%), and available for 10 reassessments (77%) and included in all (100%). Five reassessments had an outcome different from the initial REA, with 4 (2 positive and 2 negative changes) relating directly to the new study results. Reassessments often cited the inability of post-approval studies to resolve the concerns reported in the initial REA. CONCLUSION: Results from regulator-imposed post-approval studies for conditionally approved drugs were not often used in REAs by HTA organizations, because they were often not yet available at the time of initial assessment and because reassessments were scarce. When available, results from post-approval studies were almost always used within HTA, and they have led to changes in conclusions about drugs' relative effectiveness. Post-approval studies can be relevant within HTA but the current lack of alignment between regulators and HTA organizations limits their potential.

Impact of opioids on P2Y12 receptor inhibition in patients with ST-elevation myocardial infarction who are pre-treated with crushed ticagrelor: Opioids aNd crushed Ticagrelor In Myocardial infarction Evaluation (ON-TIME 3) trial.

AIMS: Platelet inhibition induced by P2Y12 receptor antagonists in patients with ST-elevation myocardial infarction (STEMI) can be affected by concomitant use of opioids. The aim of this trial was to examine the effect of intravenous (iv) acetaminophen compared with iv fentanyl on P2Y12 receptor inhibition in patients with STEMI. METHODS AND RESULTS: The Opioids aNd crushed Ticagrelor In Myocardial infarction Evaluation (ON-TIME 3) trial randomized 195 STEMI patients who were scheduled to undergo primary percutaneous coronary intervention (PCI) and were pre-treated with crushed ticagrelor to iv acetaminophen (N = 98) or iv fentanyl (N = 97) in the ambulance. The primary endpoint, consisting of the level of platelet reactivity units (PRU) measured immediately after primary PCI, was not significantly different between the study arms [median PRU 104 (IQR 37-215) vs. 175 (63-228), P = 0.18]. However, systemic levels of ticagrelor were significantly higher in the acetaminophen arm at the start of primary PCI [151 ng/mL (32-509) vs. 60 ng/mL (13-206), P = 0.007], immediately after primary PCI [326 ng/mL (94-791) vs. 115 ng/mL (38-326), P = 0.002], and at 1 h after primary PCI [488 ng/mL (281-974) vs. 372 ng/mL (95-635), P = 0.002]. Acetaminophen resulted in the same extent of pain relief when compared with fentanyl [reduction of 3 points on 10-step-pain scale before primary PCI (IQR 1-5)] in both study arms (P = 0.67) and immediately after PCI [reduction of 5 points (3-7); P = 0.96]. CONCLUSION: The iv acetaminophen in comparison with iv fentanyl was not associated with significantly lower platelet reactivity in STEMI patients but resulted in significantly higher ticagrelor plasma levels and was effective in pain relief.

Impact of vomiting on P2Y12 platelet inhibition in patients with ST-elevation myocardial infarction: A prespecified subanalysis of the ON-TIME 3 trial.

Vomiting is associated with lower levels of ticagrelor concentration and higher platelet reactivity in the early hours of ST-elevation myocardial infarction. These results support reloading with a ticagrelor loading dose and/or treatment with intravenous platelet inhibitors when patients vomit.